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We report that population dynamics in fluctuating environment accompanies mathematically 
equivalent structure to steady state thermodynamics. By employing the structure, population 
growth in fluctuating environment is decomposed into housekeeping and excess parts. The house¬ 
keeping part represents the integral of stationary growth rate for each condition during a history 
of the environmental change. The excess part accounts for the excess growth generated when en¬ 
vironment is switched. Focusing on the excess growth, we obtain Clausius inequality, which gives 
the upper bound of the excess growth. The equality is shown to be achieved in quasistatic environ¬ 
mental changes. We also clarify that this bound can be evaluated by ’’lineage fitness” that is an 
experimentally observable quantity. 


Introduction- Steady state thermodynamics (SST) was 
established for understanding a “thermodynamics” of 
transitions between nonequilibrium steady states (NESS) 
[M3- The core of this theory was proposed by Oono and 
Paniconi l] in phenomenological sense, and that is a de¬ 
composition of total heat during transitions into house¬ 
keeping and excess parts. Former represents the heat dis¬ 
sipated for maintaining NESS, and latter is the heat gen¬ 
erated due to relaxation to NESS. Based on this decom¬ 
position, Clausius inequality is reformulated in nonequi- 
librium situations. While formulated in physics, a math¬ 
ematically similar framework can be found in biological 
systems, especially in population dynamics dMi. This 
decomposition also contributes evaluation of population 
growth in fluctuating environment. 

The long term expansion rate of population size (pop¬ 
ulation growth) is the major observable in population 
dynamics which characterizes the competitive power of 
the population in evolution. In a fixed environment, this 
quantity converges to a stationary growth rate and it can 
be evaluated by the largest eigenvalue of time-evolution 
operator of the population dynamics 0- However, fluc¬ 
tuation of environment disturbs this convergence, and 
the population growth deviates from the simple integral 
of the stationary growth rates for each environmental 
state. This deviation is the major impact of fluctuat¬ 
ing environment (fitness seascape (191 - 1211 ). By employing 
the same mathematical framework as SST |22|, we can 
directly evaluate the deviation as the excess part of the 
total population growth (excess growth). In application, 
this decomposition can be exploited to design effective 
external perturbation to suppress growth of pathogenic 
and cancer cells [231. In physics, this knowledge can fa¬ 
cilitate to design a growing system to physically estimate 
free energy of a given stochastic system [24j] . 

In this letter, we deal with a heterogeneous popula¬ 
tion of organisms whose type (e.g. geno- and pheno¬ 
types) stochastically switches over time. We show that 
the total population growth in fluctuating environment 
can be generally decomposed into house-keeping and ex¬ 


cess parts. The house-keeping growth is the integral of 
the stationary growth rate for each environmental state, 
and therefore, the excess part accounts for the devia¬ 
tion from the simple integral by dynamic change in the 
environment. If the types of individuals switches by fol¬ 
lowing the detailed balance condition (DBC), the excess 
growth is shown to satisfy a Clausius inequality in which 
the entropy function is defined by the stationary mea¬ 
sure of the types switching and “lineage fitness”, which 
implies prosperity of each type in future. Clausius equal¬ 
ity is proved for quasistatic cases, and therefore excess 
growth can be exactly calculated from lineage fitnesses at 
boundaries of a history of an environmental change. In 
addition, in SST framework, a loss of population growth 
from the upper bound is translated as “entropy produc¬ 
tion”, which is evaluated by employing fluctuation re¬ 
lation. These results clarify the underlying constraints 
and thermodynamic structure of the excess growth, and 
thereby pave the way to further understanding and con¬ 
trolling of the population growth (fitness) under fluctu¬ 
ating environment. 

Setup and Clausius inequality- We consider a simple 
but general population dynamics that consists of two 
steps, type switching and duplication. Let a; be a type of 
individuals in population, and its switching dynamics is 
given by a continuous-time ergodic Markov jump process 
generated by a transition rate T ( x\x'), which denotes the 
jump rate from x’ to x. The duplication rate of individ¬ 
uals with type x in environmental condition y is denoted 
by fly (x). From above two steps, the time evolution of 
the population is described by 

dN g^ = X {Vyt (x) 6 X , X > + T (x\x')} N (x', t ), (1) 

x' 

where N (x, t) denotes the number of individuals with 
type x. 

Under this setup, we consider population growth dur¬ 
ing time interval [0,r], which is defined as Hi [Y] = 
log{7V‘ ot [Y] /iVo ot }. Here, Y denotes a history of the 
environmental change, Y = {y T , y T -At, 2/At, yo} and 
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7V t tot represents the total number of individuals in the 
population at time t, which is evaluated as iV t tot = 
Y X N (x, t). According to the SST framework, we decom¬ 
pose the population growth as ’P \Y] = \I/ hk [Y] + \l/ ex [Y], 
where 'h hk and \I/ ex denote the housekeeping and the ex¬ 
cess growth, respectively. Here, the housekeeping growth 
is defined as the integral of the stationary growth rate 
for each condition during a history Y, that is 

'I' hk [Y] = [ T A 0 (y t ) dt, (2) 

Jo 

where Ao (y) represents the stationary growth rate in 
environmental condition y. By using Eq. CD, this 
growth is calculated by the largest eigenvalue of the time- 
evolution matrix H y {-\-') = fi y (-)5. t .r +T (•!•'), that is 
T, x 'H y (x|x') v y (x 1 ) = A 0 (y) v y (x) (A 0 (y) > A .* (y)) [HI- 
Here, v y (x) is normalized as E x v y (x) = 1 and it repre¬ 
sents the largest right eigenvector, which expresses the 
occupation measure of type x in the stationary state of 
environmental condition y. On the other hand, the excess 
growth is defined by 

4' e -x [Y] = [Y] - f T A 0 (y t ) dt, (3) 

Jo 

which implies the deviation from the integral of station¬ 
ary growth rate. That is, this growth represents the 
growth generated when environment is switched. In 
this study, we assume that the transition rate T (•!•' ) 
satisfies the detailed balance condition (DBG) 1251 . 
T (x|x ; ) Pp (x') = T (x'|x) Pp (x), where P.p denotes 
the stationary measure of T(-|- / ). This assumption is 
not so restrictive biologically since geno- and pheno-type 
switching dynamics are often described by using this con¬ 
dition [15026}. (We also discuss non-DBC cases in Dis¬ 
cussion |27j|.) As shown in the following section, by em¬ 
ploying the DBG, we obtain Clausius inequality, 


Suppose that the population is in the stationary grow¬ 
ing situation with a fixed environmental condition y, that 
is, the population has the stationary occupation measure 
v y . If we track the offsprings of individuals with type x 
at a initial time, t = 0, the offsprings will change their 
types and grow in the population. The fraction of the 
offsprings (irrespective of their types) in the population 
changes over time and finally converges to some value at 
t —> oo (say PJj (x)). Then, the lineage fitness of type 
x is given as u v (x) = Pp (x) /v y (x), see FIG. 1. Ac¬ 
cordingly, if we employ a labeling technique with which 
individuals with specific types can be labeled and their 
offsprings inherit the label, we can estimate the lineage 
fitness experimentally by measuring the fraction of the 
labeled offsprings in the population. Furthermore, it is 
known that the convergence fraction Pp (x) [29| is given 
by the stationary measure of the retrospective processes 
Ry EM! (see Eq. (5) in Supplement A). Thus, we 
can calculate the lineage fitness by tracing the linage of 
the growing population time-backwardly. Next, we con¬ 
sider how to observe Pp (x) in experiments. Since Pp 
is the stationary measure of the type-switching process 
T, we can obtain it by tracing the linage of the popu¬ 
lation time-forwardly (see Supplement A). Taking these 
facts into account, we find that the entropy d5j) can be 
evaluated in experiments. 



* ex [YJ<S(y T )-S(y 0 ), (4) 


where S (y) represents “entropy" in population dynamics 
[5! , which is given by 

S (y) = \ lo S H P t 0 ) u v (x). (5) 

X 


Here, u y (x) denotes the largest left eigenvector, 
E x u y (x) H y (x\x') = u y (x')Ao(y), with normalization 
condition T, x u y (x) v y (x) = 1; and Pp represents the sta¬ 
tionary measure of the type-switching rate T (•)•'). u y (x) 
also represents “lineage fitness” of type x in environmen¬ 
tal condition y, which implies prosperity of each type in 
future H-16|. In addition, we can prove that S (y) < 0 
for arbitrary y and S (y) = 0 iff y is no selection situa¬ 
tion, i.e. fj.y (x) = const, for arbitrary x. (Proof is shown 
in Supplement C). The equality of Eq. d4} is achieved in 
quasistatic environmental changes. This entropy can be 
interpreted and experimentally observed as follows. 


FIG. 1. (color online). Types of individuals are represented 
by colors. In experiments, we can calculate the lineage fit¬ 
ness by the following steps; (i) We observe the fraction of 
individuals with type x at initial time, that is the occupation 
measure v y (x); (ii) We cultivate the population in a fixed en¬ 
vironmental condition y for a sufficiently long time; (iii) We 
finally observe the fraction of the offspring of the individuals 
with type x at initial time, which is denoted as Pr„ (*); (iv) 
We obtain the lineage fitness of type x, u v (x), by the ratio, 
Uy (x) = Pr v (x) /v y (x). 


Before working on the derivation of Clausius in¬ 
equality d3|, we consider the quasi-static situation and 
“entropy production”. In quasistatic environmental 
changes,Clausius equality , \I/ ex [Y] = S (y T ) — S(yo), is 
achieved. Therefore, the excess growth can be evaluated 
by observing entropies at boundaries of an environment¬ 
switching history Y. although it is functional of the his¬ 
tory Y. On the other hand, in non-quasistatic situa- 
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tions, “entropy production” occurs, and it is defined as 
a [Y] = {S ( y T ) — S (yo)} — ’J ,ex [V]- In terms of popula¬ 
tion dynamics, this implies a loss of population growth 
from the upper bound in non-quasistatic cases. As shown 
in the following section, this entropy production is eval¬ 
uated by Kawai-Parrondo-Van den Broeck type fluctua¬ 
tion theorem [30j, 


a [Y] = D sym [Y] + £ v Vt (x) log u Vt {x) , ( 6 ) 

X 


where D sym represents the symmetrized Kullback-Leibler 
divergence, 


D sym [Y] =Y^Pb[X\Y] log 


Pb [X\Y] 
p r 2 [X\Y] P^ 2 


X\Y 


... , (7) 
The definition and a meaning of path probabilities, 

Pb, Pr and P^, are shown in Supplement A. 

Derivation of Clausius inequality- Let us begin with 

derivation of the equality , i.e. we consider quasistatic 

environmental change. For simplicity, we rewrite Eq. m 

by using bra-ket notation as 


^\N(t))=H yt \N(t)), ( 8 ) 


where H y represents the time-evolution operator, H y = 
fiy + T and {x\H y \x') = H y (x\x')\ |JV(i)) denotes the 
population vector, that is (x\N (t)) = N (x,t). In this 
notation, the population growth if is expressed by 


= 



Texp 


[ Pyt dt 
Jo 



(9) 


where T exp [•] denotes the time-ordered exponential and 
(P| is defined as (P|x) = 1 for any \x). We write eigenval¬ 
ues of H y as A i (y), where i = 0 indicate the largest eigen¬ 
value. In addition, we prepare left and right eigenvectors 
as (Ai(y)| and |Aj (y)), respectively. These vectors are 
normalized as (A* (y) |Ay (y)) = Sij and (P|Ao (y)) = 1. 
Thus, we can write the stationary occupation measure v y 
and lineage fitness u y as v y ( x ) = (x|Ao {y)) and u y (x) = 
(Ao (y) \x), respectively. By substituting the complete¬ 
ness relation for eigenvectors £j |Aj (y)) (A i (y)| = 1 into 
Eq. ©, we have 


e'W = Y, P\K M 

X (K (Vr) |e J?v ’ rAt |Ai T _ A j (yr-At)) X • ■ • 

x (Ai At (2/At) \e Hy ^ At \X l0 (yo)> (A io ( y 0 ) \N (0)). (10) 


By assuming that initial population is stationary, that is 
|7Vo) = | Ao ( 2 / 0 )) j and by taking into account that envi¬ 
ronmental change is quasistatic, we reach 


( 11 ) 


where we employ the adiabatic approximation. By tak¬ 
ing logarithm to both sides of Eq. m, we obtain the 
population growth, 

V[Y]= [ A 0 (y t ) dt- f dt(\ 0 {y)\X y \\ 0 (y))-y, ( 12 ) 
Jo Jo 

where we use (Ao (yt+At) |A 0 (yt)) = e _ ( A °bbl v ’'l A °( 3 , )b^ At 
and Vy denotes differentiation with respect to y. The 
dots • and y represent inner product and time differ¬ 
entiation, and thus y • V y = £j (dyi/dt) (d / dyi) where 
i expresses the dimension of environment. Taking into 
account the definition of the housekeeping growth, Eq. 
ED, we can evaluate the excess growth by the second 
term of Eq. ED, ^ ex [ Y ] = ~ fo dt (A 0 (y) | V y |A 0 (y)) ■ y. 
This representation implies that the excess growth can 
be given by the geometric phase (Berry phase) [HI, ED- 
[33’. By using the completeness relation £ 3 , |x) (x| = 1, 
we find a more familiar form without bra-ket notation, 

<F ex [Y] = - f dty-Y l Uy (x) X7y V y (x). (13) 

Jo 

Next, by using the DBC assumption for the type¬ 
switching operator T, we calculate the integrand in Eq. 
ED by a potential condition. From DBC, we can obtain 
a relation between the stationary occupation measure v y 
and the lineage fitness u y as 

C (y) v y (x) = Pf (x) u y (, x) , (14) 

where the constant C (y) is given by C (y) = 

£ x Pfl (x) u y (x) = £ X P|1 (x) Uy (x). (Derivation of Eq. 
(1141) is shown in Supplement B.) By using these normal¬ 
ization and Eq. (ED, we have 

Vy j^ogC -1 ( 2 /)| =J2u v (x)XyVy(x). (15) 

By substituting Eq. (|15j) into Eq. ED, we obtain Clau¬ 
sius equality , 


* ex [Y}=S(y T )~S( yo ), (16) 

where S ( y ) denotes “entropy” defined in Eq. ©, be¬ 
cause S ( y) = ( 1 / 2 ) log C (y). 

In the following part, we derive Clausius inequality , 
i.e. we prove that Eq. (fl6l) gives the upper bound of 
the excess growth. Consider a transition between sta¬ 
tionary growing situations at environmental condition yo 
and y T . We also assume that a history of environmen¬ 
tal change, Y, is non-quasistatic during this transition. 
By employing two kinds of detailed fluctuation relation 
(FR) constructed in the population dynamics Eq. © 
and DBC assumption for type switching T, we obtain 

*ex [y] + jyym [y] + £ Vyr (*) l QgUyr {X ) 


= S (y T ) - S (yo ), 


gl ' p '1 _ (A 0 ( y T ) | e^ Ai |Ao (Vr-At)) X ••• 
x ( A 0 (2/At) \ e Hy ^ At \\ 0 ( yo )), 


X 


(17) 
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where D sym [Y] is the symmetrized Kullback-Leibler di¬ 
vergence defined in Eq. (Derivation of FRs and 

Eq. ([T71l is shown in Supplement D.) Therefore, if 
D sym \fY] + Yl x Vy T ( x ) log u Vt (x) > 0, we can obtain Clau¬ 
sius inequality (U). To prove the above inequality, we 
suppose that the final environmental condition y T = y F 
makes no selection situation, i.e. fi VF ( x ) = const, and 
thus u VF ( x) = f. By taking arbitrary intermediate en¬ 
vironmental condition yM, we consider maximum excess 
growths within intervals, yo to j/m> Um to y F , and yo to 
y F , also see FIG. 2; We denotes these maximum growths 
as * ex [Y 0 % M ], vT x [Y^] and [Y 0 % F ], where 
Y*_^.j represents the history which maximizes the excess 
growth functional ’F ex [•] in an interval [yi,yj]- By using 
Yi x Vy F ( x ) log u VF ( x) = 0 and S ( yF ) = 0, we can evalu¬ 
ate these growths as >F ex [Y 0 % M ] = {S ( y M ) - S (y 0 )} - 

{jDsym [Yq%m] + x xVyM {x) \ ogUyM (*)} , 4/- [Y ^ p ] = 

~S(y M ) and in'® [Y 0 %. F ] = -S (y M ), where we use 
Eq. (HD. Since * ex [Y 0 % M ] + 'F ex \Y^ F ] < 

'F ex i s satisfied, we obtain D sym [Yq_^ m \ + 

Y x v yM (x) log u VM (x) > 0. Then, since Y 0 %. M gives 
the maximum of T ex [■], it also attains the mini¬ 
mum of the functional D sym [•] + Y> x v VM ( x ) log u VM ( x ). 
Accordingly, for an arbitrary history Y, D sym [Y] + 
Yi x v Vt (x)logrt !/T (x) > 0 is satisfied. As a result, from 
Eq. HD, we find Clausius inequality, 

T ex [Y] = a [Y] + {S (y T ) - S (y 0 )} < S (y T ) - S (y 0 ), 

(18) 

where a [Y] denotes the entropy production defined in 

Eq. ©. 



FIG. 2. Three maximum excess growths. 


Discussion- We have established SST structure in pop¬ 
ulation dynamics. Owing to Clausius inequality, the up¬ 
per bound of excess growth is evaluated by the lineage 
fitnesses of initial and final environmental conditions. 
However, we must recall that the DBC is assumed in 
our theory. When we deal with non-DBC type switching 
(e.g. metabolic switching and circadian rhythm), Clau¬ 
sius inequality no longer available. Even for quasistatic 
environmental change, we need directly to calculate geo¬ 
metric phase (fl3l) in the similar way as Tanase-Nicolafs 
study [21], because excess growth can not be evaluated by 
the potential as in Clausius equality (fTfil) . Furthermore, 
in non-DBC situations, it is still uncertain whether geo¬ 
metric phase HD gives upper bound of the excess growth 
or not [341 ]. These are open problems in this study. 
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